in the United States Patent and Trademark Office ""* 0 



vo 



Mailed 1999 December 22 =^ 

Box Patent Application *g Q 

Assistant Commissioner for Patents n 
Washington, District of Columbia 20231 
Sir: 

Please file the following enclosed patent application papers: 
Applicant #1, Name; Kendyl A. Roman 
Applicant #2, Name: Cyrus J. Hoomani 
Applicant #3, Name: Richard S. Neale 

Title: "GENERAL PURPOSE COMPRESSION FOR VIDEO IMAGES (RHN) " 
(^Specification, Claims, and Abstract: Nr. of Sheets 27 
(^declaration: Date Signed: 1999 December 18 
^^brawing(s): Nr. of Sheets Enc: Formal: 14 Informal: 

□ Small Entity Declaration of lnventor(s) □ SED of Non-Inventor/Assignee/Licensee 

□ Assignment enclosed with cover sheet and recordal fee; please record and return, 
heck for $ 4 58.00 f or: 

458 » 00 for filing fee and additional claim fees (see attached Fee Transmittal) 

□ $ additional if Assignment is enclosed for recordal. 

Disclosure Document Program reference letter. 

ursuant to 35 U.S.C. §119(e)(i), applicant(s) claim priority of Provisional Patent Application Ser. Nr. 60/113, 276 
filed 1998 December 23 . 
(jj^eturn Receipt Postcard Addressed to Applicant #1. 

)Request Under MPEP § 707.07{j): The undersigned, a pro se applicant, respectfully requests that if the Examiner 
finds patentable subject matter disclosed in this application, but feels that Applicant's present claims are not entirely 
suitable, the Examiner draft one or more allowable claims for applicant. 




Applicant #1 Signature 

730 Bantry Court, Sunnyvale, CA 94087-3402 
Address (Send Correspondence Here) 



Express Malt Label* ; Date of Deposit 1999 December 22 



Express Mail Label # EK241178051US 



Patent Application of 
Kendyl A. Roman 
Cyrus J. Hoomani 
and 

Richard S. Neale 
for 

TITLE: GENERAL PURPOSE COMPRESSION FOR VIDEO IMAGES (RHN) 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims priority under 35 U.S.C. § 119(e) of the co-pending U.S. 

provisional application Serial Number 60/113,276 filed on 1998 December 23, and entitled 
"METHOD OF IMAGE ENHANCEMENT, COMPRESSION, AND ENCODING of 
GRAYSCALE IMAGES (ECHOCODEC)." The provisional application Serial Number 
60/113,276 filed on 1998 December 23 and entitled "METHOD OF IMAGE 
ENHANCEMENT, COMPRESSION, AND ENCODING of GRAYSCALE IMAGES 
(ECHOCODEC)" is also hereby incorporated by reference. 
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Our co-pending U.S. patent application Serial Number 90/312,922 filed on 1999* 
May 17, and entitled "SYSTEM FOR TRANSMITTING VIDEO IMAGES OVER A 
COMPUTER NETWORK TO A REMOTE RECEIVER" claims portions of the invention 
of this application in combination with claims from our co-pending U.S. provisional 
application Serial Number 60/085,818 filed on 1998 May 18, and entitled "APPARATUS 
FOR TRANSMITTING LIVE VIDEO IMAGES OVER A COMPUTER NETWORK TO 
MULTIPLE REMOTE RECEIVERS;' 

BACKGROUND - FIELD OF THE INVENTION 

This invention relates to data compression, specifically to the compression and 

decompression of video images. 

BACKGROUND-DESCRIPTION OF PRIOR ART 

In the last few years there have been tremendous advances in the speed of computer 

processors and in the availability of bandwidth of worldwide computer networks such as the 
Internet. These advances have led to a point where businesses and households now 
commonly have both the computing power and network connectivity necessary to have 
point-to-point digital communications of audio, rich graphical images, and video. However 
the transmission of video signals with the full resolution and quality of television is still out 
of reach. In order to achieve an acceptable level of video quality, the video signal must be 
compressed significantly without losing either spatial or temporal quality. 

A number of different approaches have been taken but each has resulted in less than 
acceptable results. These approaches and their disadvantages are disclosed by Mark Nelson 
in a book entitled The Data Compression Book, Second Edition, published by M&T Book in 
1996. Mark Morrision also discusses the state of the art in a book entitled The Magic of 
Image Processing, published by Sams Publishing in 1993. 
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Video Signals 

Standard video signals are analog in nature. In the United States, television signals 
contain 525 scan lines of which 480 lines are visible on most televisions. The video signal 
represent continuous stream of still images, also known a frames, that are fully scanned, 
transmitted and displayed at a rate of 30 frames per second. This frame rate is considered 
full motion. A television screen has a 4:3 aspect ratio. When an analog video signal is 
digitized each of the 480 lines are sampled 640 times and represented by a number. Each 
sample point is called a picture element, or pixel. A two dimensional array is created that is 
640 pixels wide and 480 pixels high. This 640 x 480 pixel array is a still graphical image 
that is considered to be full frame. The human eye can perceive 16.7 thousand colors. A 
pixel value comprised of 24 bits can represent each perceivable color. A graphical image 
made up of 24-bit pixels is considered to be full color. A single second-long full frame, full 
color video requires over 220 millions bits of data. The transmission of 640 x 480 pixels x 
24 bits per pixel times 30 frames requires the transmission of 221,184,000 millions bits per 
second. ATI Internet connection can transfer up to L54 millions bits per second. A high 
speed (56Kb) modem can transfer data at a maximum rate of 56 thousand bits per second. 
The transfer of full motion, full frame, full color digital video over a Tl Internet connection, 
or 56Kb modem, will require an effective data compression of over 144: 1, or 3949: 1, 
respectively. 

Basic Run-length Encoding 

An early technique for data compression is run-length encoding where a repeated 

series of items are replaced with one sample item and a count for the number of times the 
sample repeats. Prior art shows run-length encoding of both individual bits and bytes. 
These simple approaches by themselves have failed to achieve the necessary compression 
ratios. 
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Variable Length Encoding 

In the late 1940s, Claude Shannon at Bell Labs and R.M. Fano at MIT pioneered the 

field of data compression. Their work resulted in a technique of using variable length codes 
where codes with low probabilities have more bite, and codes with higher probabilities have 
fewer bits. This approach requires multiple passes through the data to determine code 
probability and then to encode the data. This approach also has failed to achieve the 
necessary compression ratios. 

D. A, Huffman disclosed a more efficient approach of variable length encoding 
known as Huffman coding in a paper entitled "A Method for Construction of Minimum 
Redundancy Codes," published in 1952.. This approach also has failed to achieve the 
necessary compression ratios. 

Arithmetic, Finite Context, and Adaptive Coding 

In the 1980s, arithmetic, finite coding, and adaptive coding have provided a slight 

improvement over the earlier methods. These approaches require extensive computer 
processing and have failed to achieve the necessary compression ratios. 

Dictionary-Based Compression 

Dictionary-based compression uses a completely different method to compress data. 

Variable length strings of symbols are encoded as single tokens. The tokens form an index 
to a dictionary. In 1977, Abraham Lempel and Jacob Ziv published a paper entitled, "A 
Universal Algorithm for Sequential Data Compression" in IEEE Transactions on 
Information Theory, which disclosed a compression technique commonly known as LZ77. 
The same authors published a 1978 sequel entitled, "Compression of Individual Sequences 
via Variable-Rate Coding," which disclosed a compression technique commonly known as 
LZ78 (see U.S. Patent 4,464,650. Terry Welch published an article entitled, "A Technique 
for High-Perf ormance Data Compression," in the June 1984 issue of IEEE Computer, which 
disclosed an algorithm commonly known as LZW, which is the basis for the GIF algorithm 
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(see US Patents 4,558302, 4,814,746, and 4,876,541). In 1989, Stack Electronics 
implemented a LZ77 based method called QIC-122 (see U.S. Patent 5,532,694, U.S. Patent 
5,506,580, and U.S. Patent 5,463390). The output of a QIC-122 encoder consists of a 
stream of data, which, in turn consists of tokens and symbols freely intermixed. Each token 
or symbol is prefixed by a single bit flag that indicates whether the following is a dictionary 
reference or a plan symbol The definitions for these two sequences are: 

(a) plaintext: <lxeight-bit-symbol> 

(b) dictionary reference: <Oxwindow-offsetxphrase-length> 

Windows offsets are encoded as seven bits or eleven bits. These lossless (method where no 
data is lost) compression methods can achieve up to 10: 1 compression ratios on graphic 
images typical of a video image. While these dictionary-based algorithms are popular, these 
approaches require extensive computer processing and have failed to achieve the necessary 
compression ratios. 

JPEG and MPEG 

Graphical images have an advantage over conventional computer data files: they can 
be slightly modified during the compression/decompression cycle without affecting the 
perceived quality on the part of the viewer. By allowing some loss of data, compression 
ratios of 25:1 have been achieved without major degradation of lie perceived image. The 
Joint Photographic Experts Group (JPEG) has developed a standard for graphical image 
compression. The JPEG lossy (method where some data is lost) compression algorithm first 
divides the color image into three color planes and divides each plane into 8 by 8 blocks, 
and then the algorithm operates in three successive stages: 

(a) A mathematical transformation known as Discrete Cosine Transform (DCT) 

takes a set of points from the spatial domain and transforms them into an 

identical representation in the frequency domain. 
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(b) A lossy quantization is performed using a quantization matrix reduce the 
precision of the coefficients. 

(c) The zero values are encoded in a zig-zag sequence (see Nelson, pp. 341-342). 
JPEG can be scaled to perform higher compression ratio by allowing more loss in the 

quantization stage of the compression. However this loss results in certain blocks of the 
image being compressed such that areas of the image have a blocky appearance and the 
edges of the 8 by 8 blocks become apparent because they no longer match the colors of their 
adjacent blocks. Another disadvantage of JPEG is smearing. The true edges in an image get 
blurred due to the lossy compression method. 

The Moving Pictures Expert Group (MPEG) uses a combination of JPEG based 
techniques combined with forward and reverse temporal differencing. MPEG compares 
adjacent frames and for those blocks that are identical to those in a previous or subsequent 
frame and only a description of the previous identical block is encoded. MPEG suffers from 
the same blocking and smearing problems as JPEG. 

These approaches require extensive computer processing and have failed to achieve 
the necessary compression ratios without unacceptable loss of image quality and artificially 
induced distortion. 

QuickTime: CinePak, Sorensen, H.263 

Apple Computer, Inc. released a component architecture for digital video 

compression and decompression, name QuickTime, Any number of methods can be 
encoded into a QuickTime compressor/decompressor (codec). Some popular codec are 
CinePak, Sorensen, and H.263. CinePak and Sorensen both require extensive computer 
processing to prepare a digital video sequence for playback in real time; neither can be used 
for live compression. H.263 compresses in real time but does so by sacrificing image 
quality resulting in severe blocking and smearing. 
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Fractal and Wavelet Compression 

Extremely high compression ratios are achievable with fractal and wavelet 

compression algorithms. These approaches require extensive computer processing and 
generally cannot be completed in real time. 

SUMMARY OF THE INVENTION 

In accordance with the present invention a method of compression of a video stream 

comprises steps of sub-sampling a video frame, determining a code for each pixel, run- 
length encoding the codes whereby the method can be executed in real time and the 
compressed representation of codes saves substantial space on a storage medium and require 
substantially less time and bandwidth to be transported over a communications link. The 
present invention includes a corresponding method for decompressing the encoded data. 

Objects and Advantages 

Accordingly, beside the objects and advantages of the method described in our patent 

above, some additional objects and advantages of the present invention are: 

(a) to provide a method of compressing and decompressing video signals so that the 
video information can be transported across a digital communications channel in 
real time. 

(b) to provide a method of compressing and decompressing video signals such that 
compression can be accomplished with software on commercially available 
computers without the need for additional hardware for either compression or 
decompression. 

(c) to provide a high quality video image without the blocking and smearing defects 
associated with prior art lossy methods. 

(d) to provide a high quality video image that suitable for use in medical 
applications. 
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(e) to provide some level of encryption so that images are not directly viewable from 
the data as contained in the transmission. 

(f) to provide a method of compression of video signals such that the compressed 
representation of the video signals is substantially reduced in size for storage on a 
storage medium- 

(g) to enhance electronically generated images by filtering highs and lows. 

DRAWING FIGURES 

In the drawings, closely related figures have the same number but different 

alphabetic suffixes. 

Fig 1 shows the high level steps of compression and decompression of an image. 
Fig 2A to 2H show alternatives for selecting a pixel value for encoding- 
Fig 3A shows the encode table of the preferred embodiment 
Fig 3B shows a chart of values corresponding to the sample encode table. 
Fig 4A shows the flowchart for the preferred embodiment of the compression 
method. 

Fig 4B shows an image and a corresponding stream of pixels. 
Fig 5A to 5C shows the formats for the run-length encoding. 
Fig 6 shows a series of codes and the resulting encoded stream. 
Fig 7 shows a sample decode table. 
Fig 8 shows an alternate method of selecting a five bit code. 
Fig 9 shows the flow chart for the preferred embodiment of the decompression 
method. 

Figs 10A to IOC show an encryption key, an encryption table and a decryption table. 

Reference Numerals in Drawings 

100 compression steps 1 10 sub-sampling step 

120 code lookup step 130 run-length encoding step 
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DESCRIPTION OF THE INVENTION 

Fig 1-Compression and Decompression Steps 

Fig 1 illustrates a sequence of compression steps 100 and a sequence of 

decompression steps 150 of the present invention. The compression steps 100 comprise a 
sub-sampling step 1 10, a code lookup step 120 and a run-length encoding step 130. After 
completion of the compression steps 100, a stream of encoded data 140 is output to either a 
storage medium or a transmission channel. The decompression steps 150 comprise a run- 
length expansion step 160 wherein the stream of encoded data 140 is processed, a value 
lookup step 170 and an image reconstitution step 180. 

Figs 2Ato2H Selecting Pixel Values for Encoding 

Figs 2A to 2G illustrate alternatives for selecting a pixel value for encoding. The 

sub-sampling step 1 10 (Fig 1) includes sub-sampling of an 8 bit pixel value to obtain a value 
for use in the subsequent code lookup step 120 (Fig 1). 
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Video digitizing hardware typical has the options of storing the pixel values as a 32 
bit pixel value 200 or a 24 bit pixel value 210, shown in Fig 2A and Fig 2B, respectively. 
The 32 bit pixel value 200 is composed of a blue channel 202, a green channel 204, a red 
channel 206, and an alpha channel 208. Each channel contains of 8 bits and can represent 
256 saturation levels for the particular color channel For each channel the saturation 
intensity value of zero represents the fully off state, and the saturation intensity value of 
"255" represents the fully on state. The 24 bit pixel value 210 is composed of a blue 
component 212, a green component 214, and a red component 216. There is no component 
for the alpha channel in the 24 bit pixel value 210. Regardless of the structure, the blue 
channel 202 is equivalent to the blue component 212, the green channel 204 is equivalent to 
the green component 214, and the red channel 206 is equivalent to the red component 216. 

In the present invention, the 32 bit pixel value 200 alternative is preferred due to the 
consistent alignment of 32 bit values in most computer memories; however for simplicity of 
illustration the alpha channel 208 will be omitted in Fig 2C to 2G. 

If the video signal is digitized in color, the three color components may have 
different values. For example in Fig 2C, a RGB averaging diagram 220 illustrates a blue 
value 222 of 35 decimal, a green value 224 of 15, and a red value 226 of 10. One alternative 
is to sub sample from 24 bits to 8 bits by averaging the three color values to obtain an 
averaged value 228 that, in this example, has the value of 20. (10+15+35)/3 = 20 

Fig 2D illustrates another alternative for selecting an 8 bit value in a blue selection 
diagram 230. In this example, a blue instance 232 has the value of 35, a green instance 234 
has the value of 15, and a red instance 236 has the value of 10. In this alternative the blue 
instance 232 is always selected as a selected blue value 240. 

Fig 2E illustrates another alternative for selecting an 8 bit value in a green selection 
diagram 250. In this alternative the green instance 234 is always selected as a selected green 
value 260. 
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Fig 2F illustrates another alternative for selecting an 8 bit value in a red selection 
diagram 270. In this alternative the red instance 236 is always selected as a selected red 
value 280. 

If the video signal being digitized is grayscale, the three color components will have 
the same values. For example in Fig 2G, a grayscale pixel 290 comprises a grayscale blue 
292 with a value of decimal 40, a grayscale green 294 with a value of 40, and a grayscale 
red with a value of 40. Because the values are all the same, it makes no difference which 
grayscale color component is selected, a selected grayscale value 298 will have the value of 
40 in this example. 

The preferred embodiment of this invention uses the low order byte of the pixel 
value, which is typically the blue component as shown in Fig 2D. 

Fig 2H illustrates an 8 bit pixel value 299 which is selected by one of the alternatives 
described above. The 8 bit pixel value 299 is equivalent to items referenced by numerals 
228, 240, 260, 280, or 298. This reduction of the 32 bit pixel value 200 or the 24 bit pixel 
value 210 contributes a reduction in data size of 4:1 or 3: 1, respectively. This reduction 
recognizes that for some images, such as medical images or grayscale images, no relevant 
information is lost. 

Fig 3 A-Encode Table 

Fig 3A illustrates an encode table 300 of the preferred embodiment of the present 

invention. The encode table 300 may be implemented in the C programming language, as 
shown, and is an array of 256 bytes. These bytes are the codes 3 10. Each line of the array 
elements is documented with one of a series of line comments 320. The line comments 320 
contain a column of minimum values 330, a column of maximum values 340, and a column 
of stepped values 360. The first column of encode table 300 is a column of line numbers 
370. The encode table is arranged such that each line contains codes 3 10 that have a value 
equal to its line number. 
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The encode table 300 reduces the 8 bit value 299 to a 5 bit code. This reduction 
recognizes that for some images, such as medical images, no relevant information was lost 
This reduction also eliminates noise from the video signal and thereby increases the 
efficiency of the run-length encoding step 130 (Fig 1), 

Fig 3B-Chart of Values 

Fig 3B, a chart of values 350, enumerates the range that the 8 bit pixel value 29!? can 

have and the respective placement of each value in the encode table 300. The first column 
of the chart enumerates the line numbers 370. Column A contains the minimum values 330 
for each line. Each row of the chart has from four to nine sequential entries. The last 
column of the chart, column J, contains the stepped values (360) that are used in the value 
lookup step 170 (Fig 1). 

Fig 4A-Encode Flowchart 

Fig 4A illustrates the encode flowchart 400 which represents the details of the 

preferred embodiment of the code lookup step 120 (Fig 1) and the run-length encoding step 
130 (Fig 1) for the present invention. 

The encoding begins at an encode entry 402. In a encode initialization step 403, a 
prior value P is set to a known value, preferably decimal "255" or hexadecimal QxFF, a 
repeat count C is set to zero, an encoded length L is set to 0, and a completion flag "Done" 
is set to a logical value of false. Next, a get pixel step 404 obtains a pixel from the image 
being encoded. At a get value step 405, a value V is set to the8 bit pixel 299 as derived from 
the pixel using one of the methods shown in Fig 2C to 2G, preferably the fastest as 
explained above. At a lookup encoded value step 406, an encoded value E is set to die value 
of one of the codes 3 10 (Fig 3) of the encode table 300 as indexed by V. Next, a compare 
previous 408 decision is made by comparing the values of E and P. If the values are the 
same, a increment counter step 410 is executed and flow continues to the get pixel step 404 
that obtains the next pixel from the image. 
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If the encode value E does not match the prior value P, then a check count overflow 
412 decision is made. If the counter C is less than or equal tol28, then a new code step 414 
is executed, otherwise a counter overflow step 420 is executed. 

At step 414, the counter C is bit-wise AND-ed with hexadecimal 0x80 which sets the 
high order bit to a binary value of 1 and is placed in the encoded data 140 buffer A at the 
next available location as indexed by the encoded length L. Then, continuing inside 
flowchart step 414, L is incremented, the prior value P is placed in the encoded data 140 
buffer A, L is incremented, the repeat count C is set to 1 and the prior value P is set to the 
encode value E. After step 414, a check end of data decision is made by checking to see if 
there are any more pixels in the image and if not if the last value is has been processed. 
Because this method utilizes a read ahead technique step 414 must be execute one more time 
after the end of data is reached to process the last run-length. If there is more data in the 
image, flow continues to a check of the completion flag "Done" at step 422. If the check 
indicates that the process is not completed, flow continues to step 404. 

If the end of data is reached but the completion flag "Done" is still false, flow 
continues to a set done step 418. At step 418, the completion flag "Done" is set to logical 
true, and flow continues to decision 412 where the last run-length will be output and flow 
will eventually exit through step 414, decision 416, decision 422, and then terminate at 
encode exit 428. 

It is possible for the repeat count C to become larger than 128 requiring more bits 
than allocated by this method. This situation is handled by making the check count 
overflow 412 decision and executing the counter overflow step 420. At step 420, the value 
hexadecimal 0x80 is placed in the encoded data 140 buffer A at the next available location 
as indexed by the encoded length L. Then, continuing inside flowchart step 420, L is 
incremented, the prior value P is placed in the encoded data 140 buffer A, L is incremented, 
the repeat count C is decrement by 128. After step 420, flows continues to the check count 
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overflow 412 decision. Thus when the encode value E repeats more that 128 times, multiple 
sets of repeat counts and encoded values are output to the encoded data 140 buffer. 

This entire process is repeated for each image or video frame and the encoded length 
L is transmitted with the encoded data associated with each frame. The encoded length 
varies from frame to frame depending on the content of the image being encoded. 

Fig 4B-Image and Pixel Stream 

Fig 4B illustrates an image and its corresponding stream of pixels. A rectangular 

image 430 is composed of rows and columns of pixels. The image 430 has a width 440 and 
a height 450, both measured in pixels. Pixels in a row are accessed from left to right. Rows 
are accessed from top to bottom. Some pixels in the image are labeled from A to Z. Pixel A 
is the first pixel and pixel Z is the last pixel. Scanning left to right and top to bottom will 
produce a pixel stream 460. In the pixel stream 460, pixels A and B are adjacent Also 
pixels N and O are adjacent even though they appear on different rows in the image. If 
adjacent pixels have the same code the process in Fig 4A will consider them in the same run. 

Because the video signal being digitized is analog there will be some loss of 
information in the analog to digital conversion. The video digitizing hardware can be 
configured to sample the analog data into the image 430 with almost any width 440 and any 
height 450. The present invention achieves most of its effective compression by sub- 
sampling the data image with the width 440 value less than the conventional 640 and the 
height 450 value less than the convention 480. The preferred embodiment of the invention 
for use in a medical application with Tl Internet transmission bandwidth is to sample at 320 
by 240. However a sampling resolution of 80 by 60 may be suitable for some video 
application. 

Figs 5A to SC-Run-length Encoding Formats 

Figs 5A to 5C show the formats for the run-length encoding. Fig 5A shows a code 

byte 500, with its high order bit designated as a flag bit 510. 
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Fig 5B shows a repeat code 520 comprising a Boolean value one in its flag bit 510 
and a 7 bit count 530 in the remaining 7 low order bits. The seven bit count 530 can 
represent 128 values with a zero representing "128" and 1 through 127 being their own 
value. 

Fig 5C shows a data code 550 comprising: 

1. a Boolean value zero in its flag bit 510 

2. two unused data bits: data bit 6 reference by 565 and data bit 5 reference by570, 
and 

3. five bits, data bits 4 to 0, reference by 575, 580, 585, 590, and 595, respectively. 
The five bits hold a 5 bit code selected from the codes 3 10 (Fig 3A) in the encode table 300 
(Fig3A). 

The preferred embodiment of this invention uses the high order bit of the code byte 
500 as the flag bit 510 because it results in the faster execution of the process. However any 
bit could have been designated as the flag bit 510 with the same logical result. 

Fig 6-Encoded Data Stream 

Fig 6 shows a series of decimal values 610 comprising a first value 620 equal to 

decimal 0, a second value 622 equal to 0, a third value 624 equal to 0, a fourth value 626 
equal to 0, a fifth value 628 equal to 0, a sixth value 630 equal to 2, and a seventh value 632 
equal to 10. After the run-length encoding step 130 (Fig 1), the corresponding encoded data 
140 (Fig 1) would be compressed down to four bytes of binary code 640 comprising a first 
byte 650 containing a repeat count 651, a second byte 652 containing a first code 653, a 
third byte 654 containing a second code 655, and a fourth byte 656 containing a third code 
657. The repeat count 651 has a binary value of "0000101" which equals decimal five 
representing the run-length of the repeating value in the first five of the decimal values 610. 
The first code 653 has a binary value of "00000" which equals the repeated decimal value 
zero. The second code 655 has a binary value of "00010" which equals the non-repeated 
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decimal value two. The third code 657 has a binary value of "01010" which equals the non- 
repeated decimal value ten. 

Fig 7-Decode Table 

Fig 7 illustrates a decode table 700 of the preferred embodiment of the present 

invention. The decode table 700 may be implemented in the C programming language, as 
shown, and is an array of 32 element with each element being a 32 bit pixel value 200 (Fig 
2A). The decode table is comprised of a column of alpha values 710, a column of red values 
720, and a column of green values 730, and a column of blue values 740, where the alpha 
values 710 are shifted by 24 bits, the red values 720 are shifted by 16 bits, and the green 
values 730 are shifted by 8 bits leaving the blue values 740 in place. The line in the decode 
table 700 contains one element Each element comprising: 

1. the alpha channel 208 (Fig 2A) with full intensity represented by hexadecimal 
OxFF 

2. the red channel 206 (Fig 2A) 

3. the green channel 204 (Fig 2A) 

4. the blue channel 202 (Fig 2A) 

where the values of the three color channels are equal to the corresponding stepped values 
360 (Figs 3A and 3B) associated with each line of the encode table 300 (Fig 3A). 

Although each element is documented as an expression composed of various bit shift 
and bit-wise OR operations, the expression is evaluated by the compiler when the program is 
compiled so that each element of the decode table 700 is a 32 bit pixel value 200 (Fig 3A) 
ready for direct placement in the decompressed image. 

In the preferred embodiment of mis invention the 32 bit pixel value 200 (Fig 2A) is 
used; however other embodiments use the 24 bit pixel value 210 (Fig 2B) or other pixel 
sizes known in the art. Embodiments of other common pixel depths of 16 bit, 15 bit, 8 bit, 4 
bit, 3 bit or 1 bit could be used without limiting the scope of this invention. Of course any 
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source resolution less than or equal to five bits would benefit from a modified and shortened 
encode and decode table or could be encoded by shifting bits as explained below* 

Fig 8-Alternate Code Selection 

Fig 8 illustrates an alternate embodiment of this invention where tables are not used 

for encoding and decoding. Instead, the high order 5 bits 810-818 of an 8 bit pixel 800 are 
shifted to the right by 3 bit positions to form a five bit sample 830. The upper 3 bits of 830 
are ignored bits 850* This shifting to obtain a five bit code replaces steps 405 and 406 of the 
flowchart in Fig 4A. The same run-length encoding method is used. During decompression 
the five bit sample 830 is shifted to the left by 3 bit positions to form a decompressed pixel 
860, where the 3 low order bits 880 are filled with zero binary values. 

Fig 9-Decode Flowchart 

Fig 9 illustrates the decode flowchart which presents the details of the preferred 

embodiment of the value lookup step 170 (Fig 1) and the image reconstitution step 180 (Fig 

The decoding beings at a decode entry 900. In a decode initialization step 901, a 
repeat counter C is set to one, an encoded length L is set to the value obtained with the 
encoded data 140 (Fig 1), and an index I is set to 0. Next, a get code step 902 obtains a 
signed byte X from the encoded data 140 (Fig 1) array A. A determine type 906 decision 
checks to see if the signed byte X is less than 0. 

If the signed byte X is less than zero, it is because the high order bit, the flag bit 510 
(Fig 5A) is set to binary value 1, as in fig 5B, indicating that the byte X is a repeat code 
520. Flow goes to assign counter step 912 where the count 530 (Fig 5B) is extracted from X 
and placed in the repeat counter C and the next code is accessed by incrementing the iadex I 
and returning to the get code step 902. 

If the signed byte X is greater than or equal to zero, it is because the flag bit 510 (Fig 
5A) is set to binary 0, as in Fig 5C, indicating that the byte X is a data code 550. How goes 
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to a decode lookup step 908 where the value of byte X is used to index into the decode table 
700 (Fig 7) to obtain a pixel value V. How continues to a check zero count 909 decision. 

The 909 decision always fails the first time ensuring that a place pixel step 910 is 
executed. The place pixel step 910 places the pixel value V in the next location of the 
decompressed image and decrements the repeat counter C and returns to the 909 decision. 
The pixel value V is placed repeatedly until C decrements to zero. Then the 909 decision 
branches flow to a reset counter step 914. At step 914 the repeat counter is reset to 1 and the 
index is incremented to select the next code. 

Flow continues to the check length 916 decision where the index I is compared to the 
encoded length L to determine if there are more codes to be processed. If I is less than L 
flow returns to step 902, otherwise the decode process terminates at a decode exit 918. 

The entire decode process is repeated for each frame image. 

Figs 10A to lOC-Encrytpion Key, Encryption Table, and Decryption Table 

Fig 10A shows an encryption key 1000, The first column shows the original code. 

The second column shows the corresponding cipher code. 

Fig 10B shows an encryption table 1010, and Fig 10C shows a decryption table 
1020* The encryption table 1010 has the same format as the standard encode table 300 (Fig 
3A), and the decryption table 1020 has the same format as the decode table 700 (Fig 7). 
However the entries in both tables are rearranged such that the direct correlation between the 
intensity level and the position in the table is broken. When these versions of the tables are 
used, the encode and decode processes and their speed of execution are substantially the 
same but the encoded data 140 (Fig 1) becomes a cipher and has a higher level of security. 
It should be recognized by one with ordinarily skill in the art Chat there are other 
embodiments of the present invention with different encryption/decryption table 
rearrangements. 
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Advantages 

Filtering and Image Enhancement 

The stepped values 360 (Fig 3A) are a significant discovery of the present invention. 

The use of these specific values results in high quality decompressed images when the 
original image is generated by an electronic sensing device such as an ultrasound machine. 
The encode table 300 is arranged such that the spikes in the video signal are filtered in the 
high and low end, line numbers 3 1 and 0, respectively. The remaining values are distributed 
more evenly with larger ranges at line 3, 7, 15, 19, 23, and 27. 

By altering the contents of the encode table 300 and the decode table 700 various 
filters can be implemented to enhance the image quality. A high or low noise filter can be 
beneficial when the image is generated by an imaging technology such as radar, ultrasound, 
x-ray, magnetic resonance, or similar technology. Variations in the encode and decode table 
can be made to enhance the perceived quality of the decompressed image. Therefore, 
altering the contents, shape, or size of the encode table 300 and the decode table 700 is 
anticipated by this invention and specific values in the tables should not be construed as 
limiting the scope of this invention. 

Execution Speed 

The preferred embodiment of this invention use a number of techniques to reduce the 
time required to compress and decompress the data. 

The methods require only a single sequential pass through the data. Both the 
compression steps 100 and the decompression steps 150 access a pixel once and perform all 
calculations. 

When selecting the 8 bit pixel value 299, the preferred embodiment selects the low 
order bits from the 32 bit pixel value 200 or the 24 bit pixel value 210 so that an additional 
shift operation is avoided. 
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The encode table 300 is a fast and efficient way to convert the 8 bit pixel value 299 
into one of the 5 bit codes 3 10. 

The decode table 700 contains 32 entries each comprised of the 32 bit pixel value 
200 that are ready for placement in the decompressed image. Although each element is 
documented as an expression composed of various bit shift and bit-wise OR operations, the 
expression may also be evaluated by a compiler when the program is compiled so that each 
element of the decode table 700 becomes a 32 bit pixel value 200. 

General Purpose 

Although the preferred embodiment of the present invention is tuned to the 
characteristics of a medical image, its lossless compression of the sampled data results in 
high quality video streams that have general purpose application in a number of areas 
including, without limitation, video conferencing, surveillance, manufacturing, and rich 
media advertising. 

Lossless Nature/No Artifacts 

Once the analog signal is sub-sampled and filtered to select a five bit code value 

which eliminates some of the real world defects, the methods of the present invention 
compress and decompress the data with no irreversible data loss* Unlike JPEG and MPEG, 
the decompressed image never suffers from artificially induced blocking or smearing or 
other artifacts that are result of the lossy compression algorithm itself. As a result even a 
small sub-sample of the image remains clear and true to the perceived quality of the original 
image. 

Conclusion, Ramification, and Scope 

Accordingly, the reader will see that the compression and decompression steps of the 

present invention provides a means of digitally compressing a video signal in real time, 
communicating the encoded data stream over a transmission channel, and decoding each 
frame and displaying the decompressed video frames in real time. 
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Furthermore, the present invention has additional advantages in that: 

1 . it provides a means of filtering real world defects from the video image and enhancing 
the image quality; 

2. it allows for execution of both the compression and decompression steps using software 
running on commonly available computers without special compression or 
decompression hardware; 

3. it provide decompressed images that have high spatial quality that are not distorted by 
artifacts of the compression algorithms being used; 

4. is provides a scalable means of video compression; and 

5. it provides a means for reducing the space required in a storage medium. 

Although the descriptions above contain many specifics, these should not be 
construed as limiting the scope of the invention but as merely providing illustrations of some 
of the preferred embodiments of this invention. For example, stepped values in the encode 
and decode tables can be altered and the same relative operation, relative performance, and 
relative perceived image quality will result Also, these processes can each be implemented 
as a hardware apparatus that will improve the performance significantly. 

Thus the scope of the invention should be determined by the appended claims and 
their legal equivalents, and not solely by the examples given. 
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: We claim: 

A method of compression of graphic images which make up a video stream, 
comprising the steps of: 

(a) sub-sampling pixels from an image selected from said graphic images; 

(b) selecting a code based on a number of bits from each pixel selected from said 
pixels; 

(c) run-length encoding repeated instances of said code; 

(d) repeating steps (b) and (c) until each said pixel is encoded in an encoded data 
buffer; and 

(e) streaming said buffer which represents said graphic images. 

The method of claim 1 wherein the rate of sub-sampling frames is greater than or 
equal to 15* 

The method of claim 1 wherein image dimensions are less than or equal to 320 by 
240. 

The method of claim 1 wherein said number of bits is five and said code is 
determined by extracting the five most significant bits from each pixel. 
The method of claim 1 wherein said number of bits is five and said code is obtained 
from an encode table. 

An encoded video signal comprising a series of said encoded data buffers. 

A storage medium in which the encoded video signal as claimed in claim 6 is stored. 

A method of decompressing an encoded video signal, comprising the steps of: 

(a) reading a stream of run-length encoded codes; 

(b) determining a series of pixels based on the values and run-lengths of said 
codes; 

(c) combining said pixels into an image; and 

(d) displaying a series of said images. 
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9- The method of claim 8 wherein the display frame rate is greater than or equal to 15. 
10. The method of claim 8 wherein the width and the height of said image are less than 

or equal to 320 by 240, respectively. 
1 L The method of claim 8 wherein said codes are five bits in length and said pixel's 

values are determined by using the least significant bits of said codes as the five most 

significant bits of each pixel. 

12. The method of claim 8 wherein each of said pixel values are obtained from a decode 
table, whereby said image is an enhanced representation of the original image. 

13. The method of claim 5 wherein the lines of said encode table are randomly ordered 
forming an encryption table so that the direct correlation between the original values 
and their representative codes are encrypted. 

14. The method of claim 12 wherein the lines of the decode table are ordered in a 
sequence matching said encryption table so that the correct final pixel values are 
displayed. 

15^ A machine for compressing of a plurality of video frames which make up a video 
signal, comprising 

(a) a video digitizer configured to digitizing a frame from said video frames; 

(b) a video memory which is able to receive a plurality of pixels from said video 
digitizer; 

(c) run-length encoding circuit for counting repeated instances of a pixel value 
when scanning said plurality of pixels and output a series of run-lengths and 
code values as encoded data; 

(d) a memory which is able to store said encoded data; 

(e) an input/output device. 

16. The machine of claim 15 wherein said run-length encoding circuit performs a table 
lookup to translate said pixel values into encrypted enhancement codes. 
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The machine of claim 15 wherein said input/output device is a storage medium. 
The machine of claim 15 wherein said input/output device is a communications 
transmission channel. 

A machine for decompressing an stream of encoded data that represents a video 
signal, comprising: 

(a) an input/output device for reading said stream of encoded data; 

(b) a run-length decoding circuit which can decode the encoded data and output a 
stream of pixel values; and 

(c) a memory that is able to store an image comprising said stream of pixel 
values that can be displayed as frames of a video sequence. 

The machine of claim 19 wherein said run-length decoding circuit performs a decode 
table lookup. 
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GENERAL PURPOSE COMPRESSION FOR VIDEO IMAGES (RHN) 
Abstract: Methods, medium, and machines which compress, encode, enhance, 
transmit, decompress and display digital video images in real time. Real time compression 
is achieved by sub-sampling each frame of a video signal, encoding and filtering the pixel 
values to codes, and run-length encoding the codes. Real time transmission is achieved due 
to high levels of effective compression. Real time decompression is achieved by decoding 
and decompressing the encoded data to display high quality images. 
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int decodeTable[ ] = 
{ ✓ 710 



< 




0xff « 24 I 0 « 16 I 0 « 8 I 0, 
faff « 24 I 8 « 16 I 8 « 8 I 8, 
0xff « 24 I 16 « 16 I 16 « 8 I 16, 
0xff « 24 I 24 « 16 I 24 « 8 I 24, 
0xff « 24 I 33 « 16 I 33 « 8 I 33, 
0xff « 24 I 41 « 16 I 41 « 8 I 41, 
0xff « 24 I 49 « 16 I 49 « 8 I 49, 
0xff « 24 I 57 « 16 I 57 « 8 I 57, 
0xff « 24 I 66 « 16 I 66 « 8 I 66, 
0xff « 24 I 74 « 16 I 74 « 8 I 74, 
0xff « 24 I 82 « 16 I 82 « 8 I 82, 
0xff « 24 I 90 « 16 I 90 « 8 I 90, 
0xff « 24 I 99 « 16 I 99 « 8 I 99, 
0xff « 24 I 107 « 16 I 107 « 8 I 107, 
0xff « 24 I 115 « 16 I 115 « 8 I 115, 
0xff « 24 f 123 « 16 I 123 « 8 I 123, 
0xff « 24 I 132 « 16 I 132 « 8 I 132, 
0xff « 24 I 140 « 16 I 140 « 8 I 140, 
0xff « 24 I 148 « 16 I 148 « 8 I 148, 
0xff « 24 I 156 « 16 I 156 « 8 I 156, 
0xff « 24 I 165 « 16 I 165 « 8 I 165, 
0xff « 24 I 173 « 16 I 173 « 8 I 173, 
0xff « 24 I 181 « 16 I 181 « 8 I 181, 
0xff « 24 I 189 « 16 I 189 « 8 I 189, 
0xff « 24 I 198 « 16 I 198 « 8 I 198, 
0xff « 24 I 206 « 16 I 206 « 8 I 206, 
0xff « 24 f 214 « 16 I 214 « 8 I 214, 
0xff « 24 I 222 « 16 I 222 « 8 I 222, 
0xff « 24 I 231 « 16 I 231 « 8 I 231, 
0xff « 24 I 239 « 16 I 239 « 8 I 239, 
0xff « 24 I 247 « 16 \ 247 « 8 I 247, 
0xff « 24 I 255 « 16 I 255 « 8 I 255 
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18, 


18, 


18, 


18, 


18, 




// 


5 




12 


-> 8 


25, 


25, 


25, 


25, 


25, 


25, 


25, 


25, 




// 


13 




20 


-> 16 


5, 


5, 


5, 


5, 


5, 


5, 


5, 


5, 


5, 

7 


// 


21 




29 


-> 24 


3, 


3, 


3, 


3, 


3, 


3, 


3, 


3, 




// 


30 




37 


-> 33 


6, 


6, 


6, 


6, 


6, 


6, 


6, 


6, 




// 


38 




45 


-> 41 


12, 


12, 


12, 


12, 


12, 


12, 


12, 


12, 




// 


46 




53 


-> 49 


30, 


30, 


30, 


30, 


30, 


30, 


30, 


30, 


30, 


// 


54 




62 


-> 57 


21, 


21, 


21, 


21, 


21, 


21, 


21, 


21, 




// 


63 




70 


-> 66 


27, 


27, 


27, 


27, 


27, 


27, 


27, 


27, 




// 


71 




78 


-> 74 


1, 


1. 


1, 


1, 


1, 


1, 


1, 


1, 




// 


79 




86 




16, 


16, 


16, 


16, 


16, 


16, 


16, 


16, 


16, 


// 


87 




95 


-> 90 


31, 


31, 


31, 


31, 


31, 


31, 


31, 


31, 




// 


96 




103 


-> 99 


4, 


4, 


4, 


4, 


4, 


4, 


4, 


4, 




// 


104 




111 


_> 107 


14, 


14, 


14, 


14, 


14, 


14, 


14, 


14, 




// 112 




119 


-> 115 


20, 


20, 


20, 


20, 


20, 


20, 


20, 


20, 


20, 


// 120 




128 


-> 123 


10, 


10, 


10, 


10, 


10, 


10, 


10, 


10, 




// 129 




136 


-> 132 


28, 


28, 


28, 


28, 


28, 


28, 


28, 


28, 




// 137 




144 


-> 140 


23, 


23, 


23, 


23, 


23, 


23, 


23, 


23, 




// 145 




152 


-> 148 


9, 


9, 


9, 


9, 


9, 


9, 


9, 


9, 


9, 


// 153 




161 


-> 156 


15, 


15, 


15, 


15, 


15, 


15, 


15, 


15, 




// 162 




169 


-> 165 


22, 


22, 


22, 


22, 


22, 


22, 


22, 


22, 




// 170 




177 


-> 173 


29, 


29, 


29, 


29, 


29, 


29, 


29, 


29, 




// 178 




185 


-> 181 


13, 


13, 


13, 


13, 


13, 


13, 


13, 


13, 


13, 


// 186 




194 


-> 189 


19, 


19, 


19, 


19, 


19, 


19, 


19, 


19, 




// 195 




202 


-> 198 


26, 


26, 


26, 


26, 


26, 


26, 


26, 


26, 




// 203 




210 


-> 206 


2, 


2, 


2, 


2, 


2, 


2, 


2, 


2, 




// 211 




218 


-> 214 


17, 


17, 


17, 


17, 


17, 


17, 


17, 


17, 


17, 


// 219 




227 


-> 222 


0, 


0, 


0, 


®, 


0, 




«, 


0, 




// 228 




235 


-> 231 


8, 


8, 


8, 


8, 


8, 


8, 


8, 


8, 




// 236 




243 


-> 239 


11, 


11, 


11, 


11, 


11, 


11, 


11, 


11, 




// 244 




251 


-> 247 


7, 


7, 


7, 


7 












// 252 




255 


-> 255 
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^ 1020 

int decodeTabte[ ] - 
{ 



0xff 


« 


24 1 


231 


« 


16 1 


231 « 8 1 


231, 


0xff 


« 


24 1 


82 


« 


16 1 


82 « 8 1 


82, 


0Xff 


« 


24 1 


214 


« 


16 1 


214 « 8 1 


214, 


0xff 


« 


24 1 


33 


« 


16 1 


33 « 8 1 


33, 


0xff 


« 


24 1 


107 


« 


16 1 


107 « 8 1 


107, 


0xff 


« 


24 1 


24 


« 


16 1 


24 « 8 1 


24, 


0xff 


« 


24 1 


41 


« 


16 1 


41 « 8 1 


41, 


0xff 


« 


24 1 


255 


« 


16 1 


255 « 8 1 


255, 


0xff 


« 


24 1 


239 


« 


16 1 


239 « 8 1 


239, 


0xff 


« 


24 1 


156 


« 


16 i 


156 « 8 1 


156, 


0xff 


« 


24 1 


132 


« 


16 1 


132 « 8 1 


132, 


0xff 


« 


24 1 


247 


« 


16 1 


247 « 8 


247, 


0Xff 


« 


24 1 


49 


« 


16 1 


49 « 8 


49, 


0xff 


« 


24 1 


189 


« 


16 1 


189 « 8 


189, 


0xff 


« 


24 1 


115 


« 


16 1 


115 « 8 


115, 


0xff 


« 


24 1 


165 


« 


16 1 


165 « 8 


165, 


0xff 


« 


24 1 


90 


« 


16 1 


90 « 8 


i 90, 


0xff 


« 


24 1 


222 


« 


16 1 


222 « 8 


1 222, 


0xff 


« 


24 1 


8 


« 


16 1 


8 « 8 


1 8, 


0xff 


« 


24 1 


198 


« 


16 1 


198 « 8 


1 198, 


0xff 


« 


24 1 


123 


« 


16 1 


123 « 8 


1 123, 


0xff 


« 


24 1 


66 


« 


16 1 


66 « 8 


1 66, 


0xff 


« 


24 1 


173 


« 


16 1 


173 « 8 


1 173, 


0xff 


« 


24 1 


148 


« 


16 1 


148 « 8 


1 148, 


0xff 


« 


24 1 


0 


« 


16 1 


0 « 8 


1 0, 


0xff 


« 


24 1 


16 


« 


16 1 


16 « 8 


1 16, 


0xff 


« 


24 1 


206 


« 


16 1 


206 « 8 


1 206, 


0xff 


« 


24 1 


74 


« 


16 1 


74 « 8 


1 74, 


0xff 


« 


24 1 


140 


« 


16 1 


140 « 8 


1 140, 


0xff 


« 


24 1 


181 


« 


16 1 


181 « 8 


1 181, 


0xff 


« 


24 1 


57 


« 


16 1 


57 « 8 


1 57, 


0xff 


« 


24 1 


99 


« 


16 1 


99 « 8 


1 99 
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Combined Declaration for Patent Application and Power of Attorney 



As a below-named inventor, I hereby declare that my residence, post office address, 
and citizenship are as stated below next to my name and that I believe that I am the 
original, first, and sole inventor [if only one name is listed below] or an original, first, and 
joint inventor [if plural names are listed below] of the subject matter which is claimed 
and for which a patent is sought on the invention, the specification of which is attached 
hereto and which has the following title: 

"GENERAL PURPOSE COMPRESSION FOR VIDEO IMAGES (RHN)" 
I have reviewed and understand the contents of the above-identified specification, 
Including the claims, as amended by any amendment specifically referred to in the oath 
or declaration. I acknowledge a duty to disclose information which is material to the 
examination of this application in accordance with Title 37, Code of Federal 
Regulations, Section 1.56(a). 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under Title 18, United 
States Code, Section 1001 , and that such willful false statements may jeopardize the 
validity of the application or any patent issued thereon. 

I hereby claim the benefit under Title 35, United States Code, § 1 19(e) United States 
provisional patent application Serial No. 60/1 13,276 filed on December 23, 1998. 

I hereby appoint Kendyl A. Roman as my attorney with full power of substitution to 
prosecute this application and transact ail business in the Patent and Trademark Office 
in connection therewith. 

Please send correspondence and make telephone calls to the First Inventor below. 



Post Office Address: 730 Bantry Court, Sunnyvale, CA 94087-3402 



Signature: Sole/First Inventor: , 

Print Name: Kendyl A. Roman 



Date: 1999 December 18 



Legal Residence:* Sunnyvale, ca 



Citizen of: usa 



Telephone: (408) 739-9517 



Signature: Joint/Second Inventor: 



Print Name: Cyrus J. Hoomani • ' Date: 1999 December 18 

Legal Residence:* San Francisco, ca Citizen of: usa 

Post Office Address: 300 Monterey Blvd., Apt. 205 

San Francisco, CA 94131 



Telephone: (415) 587-6614 



Signature: JoinVThird Inventor: 

Print Name: Richard S. Neale Date: 

Legal Residence:* Sunnyvale, ca Citizen of: usa 

Post Office Address: 

Sunnyvale, CA 94087 

Telephone: (408) 732-2683 



